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(54) Image pickup apparatus 

(57) An image pickup apparatus comprising first and 
second image pickup portions for receiving at least a 
first wavelength component of an object light and a sec- 
ond wavelength component of the object light different 
from the first wavelength component, respectively, a first 
optical system for projecting the object light onto the first 
image pickup portion, a second optical system for pro- 
jecting the object light onto the first and second image 
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pickup portions via an optical path ditferent from that of 
The first optical system, and a guide path forming portion 
lorformlngaguide path tor receiving the object light pro- 
jected by the first optical system and guiding the re- 
ceived object light to the first image pickup portion, and 
for receiving the object light projected by the second op- 
tical system onto the first image pickup portion and not 
guiding the object light to the first image pickup portion. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to an image pick- 
up apparatus capable of picking up a dynamic image or 
a still image such as a video camera. 

Related Background Art 

[0002] In a digital color camera, in response to press- 
ing down of a RELEASE button, an image in a field is 
exposed to a solid-state image pickup element such as 
a CCD or a CMOS sensor for a desired time period. An 
image signal thus obtained and representing a still im- 
age of a picture is converted into a digital signal and is 
subject to predetermined processing such as the YC 
processing, and me image signal of a predetermined 
format is obtained Digital image signal representing the 
picked-up image Is recorded in a semiconductor mem- 
ory on a one picture basis. The recorded image signal 
is read according to the need, to be reproduced as signal 
capable of being displayed or printed, and are outputted 
to a monitor or the like to be displayed. 
[0003] One example of a technology forthinnlng adig- 
ital color camera is disclosed in Japanese Patent Appli- 
cation Laid-open No. 10-145602. In Japanese Patent 
Application Laid-open No. 10-145802, an image pickup 
screen is divided into a plurality of regions, and an im- 
aging optical system is provided for aach of the regions 
to form a partial image of an object- in this case, one 
object image is fonmed by one imaging optical system, 
and object images the number of which corresponds to 
the number of the divisions of the image pickup screen 
are projected onto a single image pickup element, in ad- 
dition, object image separating walls referred to as vis- 
ual field remit baffles are provided. The visual field limit 
baffles are disposed between the imaging optical sys- 
tems and the image pickup element, and function as 
walls tor preventing light from adjacent imaging optical 
systems from leaking in. 

[0004] Since the visual field limit baffles are partitions 
in image pickup regions, the more image pickup regions 
are segmentized, the more area is necessary for the vis- 
ual field limit baffles. This is an obstacle to miniaturiza- 
tion of the image pickup element It lowers the produc- 
tion yield to make larger the whole area of the image 
pickup element extremely, and, due to limitation on the 
cost, an upper limit is practically placed on the size of 
the image pickup element. 

SUMMAFfV OF THE INVENTION 

[0005] According to one aspect of the present inven- 
tion, there is provided an image pickup apparatus com- 
prising first and second image pickup portions for receiv- 



ing at least a first wavelength component of an object 
light and a second wavelength component of the object 
light different from the first .wavelength component, re- 
spectively, a first optical system for projecting the object 

s light onto the first image pickup portion, a second optical 
system for projecting the object light onto the first and 
second image pickup portions via an optical path differ- 
ent from that of the first optical system, and a guide path 
forming portion for forming a guide path which receives 

to the object light projected by the first optical system and 
guides the received object light to the first image pickup 
portion and for receiving the object light projected by the 
second optical system onto the first image pickup por- 
tion and not guiding the received object light to the first 

75 image pickup portion. The image pickup apparatus of 
the present invention does not require an object image 
separating wall, and can attain small-sked apparatus. 
[0006] Other aspects of the present invention will be- 
come apparentfrom the following specific preferred en> 

£0 bodiments. 

BRIEF DESCRIPTION OF THE DRAWINGS 



[OO07] 

23 

Fig. 1 is a sectional view of an image pickup system 
of a digital color camera according to an embodi- 
ment of the present invention; 
Fig. 2 i3 a front view of a solid-state image pickup 

so element of the image pickup system shown in Fig, 1 ; 
Fig. 3 is a plan view of a diaphragm of the image 
pickup system shown in Fig. 1; 
Fig. 4 illustrates the ranges where optical filters of 
the image pickup system shown in Fig. 1 are 

9$ formed; 

Fig. 5 Illustrates an objective fens of the Image pick- 
up system shown in Fig. 1 which is viewed from the 
side where light is projected; 
Fig. 6 is a graph showing the spectral transmission 

40 factor characteristics of the optical filters of the im- 
age pickup system shown in Fig, i; 
Fig. 7 is a graph showing the spectral transmission 
factor characteristics of a color puhty correction fil- 
ter of the image pickup system shown in Fig. 1 ; 

4S Fig. S is a graph showing the spectral transmission 
factor ch aracteristics of a photochrome glass of the 
image pickup system shown in Fig, 1 ; 
Fig. 9 is a graph showing the transmission factor 
distribution of a transmission factor distribution type 

so filter of the image pickup system shown in Fig. 1 ; 
Fig. 10 is a graph showing the OTF characteristics 
of the objective lens of the image pickup system 
shown in Fig. 1; 

Fig. 11 is a graph showing the intensity distribution 
55 in an image by the image pickup system shown in 

Fig. i; 

Fig. 12 is an explanatory viewfor explaining the set- 
ting of the intervals between lens portions ot the im- 
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age pickup system shown in Fig. 1; 
Fig. 1 3 is an explanatory view tor explaining the po- 
sitions of images of an object at infinity of the image 
pickup system shown in Fig. 1; 
Fig. 14 is a block diagram of a signal processing 
system of the digital color camera shown in Fig. 1; 
Fig. 15 illustrates the positional relationship of the 
image pickup region for R and B pixels with respect 
to th e image pickup region for a G pixel of the image 
pickup system shown in Fig. 1 ; 
Fig. 16 is an explanatory view of interpolation 
processing of the digital color camera shown hi Fig. 
1; 

Figs. 17A, 17B, and 17C illustrate the overall struc- 
ture of the digital color camera shown in Fig. v, 
Fig. 13 is a sectional view of an image pickup sys- 
tem of a digital color camera according to a second 
embodiment of the present invention; 
Fig. 1 9 is a sectional view of another image pickup 
system of a digital color camera according to the 
second embodiment of the present invention; 
Fig, 20 is a front view of a solid-state image pickup 
element according to the second embodiment of the 
present invention; 

Fig. 21 is a sectional view of an image pickup sys- 
tem of a digital color camera according to a third 
embodiment of the present invention; 
Fig. 22 is a from view of a solid-state image pickup 
element of the image pickup system shown in Fig. 
21; and 

Fig. 23 is an explanatory view of the action of a mi- 
crolens of the Image pickup system shown in Fig. 
21. 

DESCRIPTION OF TTHE PREFERRED 
EMBODIMENTS 

[0006] Preferred embodiments of the present inven- 
tion are now described in detail with reference to the 
drawings. 

[0009] Figs, 17A, 17B, and 17C illustrate the overall 
structure of a digital color camera according to a first 
embodiment of the present invention. Figs. 17A, 17C, 
and 1 7B are a front view, a rear view, and a sectional 
view taken along the line 17B-17B in the rear view of 
Fig. 17C, respectively. 

[0010] In Figs. 17A, 17B. and 17C. reference numeral 
1 denotes a camera body* An illuminating light intake 
window 2 formed Of a white diffusing plate is positioned 
at the back of a color liquid crystal monitor 4, Reference 
numerals 5 and 6 denote a main switch and a RELEASE 
button, respectively. Reference numerals 7. 8, and 9 are 
switches for a user to set the state of the camera In 
particular; the reference numeral 9 denotes a PLAY but- 
ton. A reference numeral 13 denotes a display of the 
remaining number of recordable pictures. Object light 
which is incident into a prism 12 from a viewfinder front 
frame 3 is projected from a viewfinder eyepiece window 
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11. Reference numerals 10 and 14 denote an image 
pickup system and a connection terminal for connecting 
to an external computer or the like to transmit and re- 
ceive data, respectively. 
5 [0011] the schematic structure of asignal processmg 
system is now described. Fig. 14 is a block diagram of 
the signal processing system. This camera is a single 
plate type dig ital color camera using a solid-state image 
pickup element 120 such as a CCD or a CMOS sensor 
10 image signals representing a dynamic image or a elBI 
image are obtained by driving theeolid-state image pick- 
up element 1 20 continuously or onty once. Here, the sol- 
id-state image pickup element 120 is an image pickup 
device of the type which converts exposed light into 
1$ electric signals with regard to the respective pixels, 
stores respective charges according to the light amount, 
and reads the respective charges. 
[0012] It Is to be notedthat Fig. 1 4 only shows portions 
Which are directly relevant to the present invention, and 
so illustration and description of portions which are not di- 
rectly relevant to the present invention are omitted. 
[0013] As shown in Fig. 14. the image pickup appara- 
tus has the image pickup system 1 0, an image process- 
ing system 20 as an image processing means, a record* 
25 jng and reproduction system 30. and a control system 
40. Further, the image pickup system 1 0 includes there- 
in an objective lens 100. a diaphragm 1l0,andthe solid- 
state image pickup element 120, the image processing 
system 20 includes therein an A/D converter 500, an 
so RGB image processing circuit2l0, and a YC processing 
circuit 230. the recording and reproduction system 30 
frieluSes therein a recording processmg circuit 300 and 
a reproduction processing circuit 310. and the control 
system 40 includes therein a system control unit 400. 
3S an operation detection circuit 410, andadrivecircuit420 
of the soBd-state image pickup element. 
[0014] The image pickup system 10 is an optical 
processing system for imaging light incident from an ob- 
ject through the diaphragm 110 and the objective lens 
40 1 00, on an image pickup plane of the solid-state image 
pickup element. The light transmission factor of the ob- 
jective lens 100 is adjusted to expose a subject image 
of an appropnate light amount to the solid-state image 
pickup element 120. As described in the above, as the 
45 solid-state image pickup element 1 20, an image pickup 
device such as a CCD and a CMOS sensor i6 applied. 
By controlling the exposure time and the exposure in- 
tervals of the solid-state image pickup element 120, im- 
age signals representing continuous dynamic images or 
so image signals representing a still image by one expo- 
sure can be obtained. 

[0015] Fig. 1 is a detailed view of the image pickup 
system 10- First, the diaphragm 110 has three circular 
openings 110a, 110b, and 1l0c as shown in Fig. 3. Ob- 
& ject light which enters a light incidence pfane 100e oi 
the objective lens 100 from the openings are projected 
from three lens portions 100a, 100b. and 100c of the 
objective lens 100 to form three object images on the 
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image pickup plane of the solid-state image pickup ele- 
ment 120. the diaphragm 110, the light incidence plane 
lOOe, and the image pickup plane of the solid-state im- 
age pickup element 1 20 are in parallel with one another, 
in this way, by making weak the power on the incidence 
side, making strong the power on the projection side, 
and providing a diaphragm on the incidence side, the 
curvature of the image plane can be made less. It is to 
be noted that, though the light incidence plane tOOe of 
the objective lens 1 00 is a plane here, the light incidence 
plane I00e may be formed of three spherical surfaces 
or three rotation^ymmetry nonepherical surfaces. 
[001 61 The three lens portions 1 00a, 1 00b, and 1 00c 
have circular spherical surface portions as shown in Fig. 
5 showing the objective tens 100 viewed from the side 
where light is projected An infrared radiation cutting fil- 
ter having a low transmission factor with regard to the 
wavelength range of 670 nm end more is formed on the 
spherical surface portions while a light-shielding film is 
formed on a plane portion lOOd shown with Hatching- 
More specifically, the objective optical system is formed 
with the objective lens 1 00 and the diaph ragm 1 1 0, while 
the three lens portions 100a, 100b, and 100c are the 
imaging system. 

[0017] The manufacturing is easy with using glass 
molding in case the objective lens 100 is made of glass 
and with using injection molding in case the objective 
lens 100 is made of resin. 

[0018] Fig. 2 Is a front view of the solid-state image 
pickup element 120. The solid-state Image pickup ele- 
ment 120 is provided with three Image pickup regions 
120a 120b, and I20ccorrespondingtotheforrnedthree 
object images. Each of the image pickup regions 120a, 
1 2b, and 1 20c are sized to be 2.24 mm X 1 .68 mm with 
the arrangement of 800 x 600 pixels having the vertical 
and horizontal pitch of 2.6 urn. The size of the whole 
image pickup regions is 2.24 mm X 5.04 mm. The diag- 
onal size of each ot the image pickup regions is 2.00 
mm In the figure, image circles 51 a, 51 b. and 51 c within 
which an object image is formed are circular, the si2es 
of which circles are determined by the size of the open- 
ings of the diaphragm and the spherical surface portions 
on the projection side of the objective lens 100. The im- 
age circles 51 a and 51 b overlap each other and the im- 
age circles 51b and 51c overlap each other. 
[0019] In Fig. 1, hatched portions 52a. 52b, and 52c 
sandwiched between the diaphragm 110 and the objec- 
tive lens 100 are optical filters formed on the light inci- 
dence plane 100e of the abjective lens 100. As shown 
in Fig. 4 showing the objective lens 1 00 viewed from the 
light Incidence side, the optical filters 52a, 52b, and 52c 
are formed in regions which completely include tha dia- 
phragm openings 110a. 110b, and 110c, respectively. 
[0020] The optical filter 52a has spectral transmission 
factor characteristics shown as G in Fig. 6 which mainly 
transmit green, the optical filter 52b has spectral trans- 
mission factor characteristics shown as FT which mainly 
transmit red, and the optical filter 52c ha© spectral trans- 



mission factor characteristics shown as B which mainly 
transmit blue, and thus, these are primary color filters. 
As the product with the characteristics of the infrared 
radiation cutting filter formed on the lens portions 100a. 
5 100b, and 100c, the object images formed in the image 
circles 51a. 51b. andStc are of green light component, 
red light component, and blue light component, respeo- 
tively. 

[0021] On the other hand, optical filters 53a. 53b, and 
to 53c are formed on the three image pickup regions 120a, 
120b. and 120c, respectively, of the solid-state image 
pickup element 120. Their spectral transmission factor 
characteristics are equivalent to the ones shown in Fig. 
6. More specifically, the image pickup regions 120a. 
is 120b, and 120c are sensitive to green light (G), red light 
(R). and blue light (B), respectively. 
[0022] Since the spectral distributions of the recerved 
light of the respective image pickup regions are given 
as the product of the spectral transmission factors ol the 
20 pupils and me spectral transmission factors of the image 
pickup regions, respectively, the combination of the pu- 
pil and the image pickup region is selected according to 
the wavelength range. More specifically, object light 
which goes through the diaphragm opening 110a is 
*s mainly photoelectrical^ converted in the image pickup 
region 120a, object light which goes through the dia- 
phragm opening 11 0b is mainly photoelectrical^ con- 
verted in the image pickup region 120b, and object light 
which goes through the diaphragm opening 110c is 
so mainly photoelectrically converted in the image pickup 
region 120c. In other words, the image pickup regions 
120a, 120b. and 120c output a G image, an R image, 
and a B image, respectively. In this way, by using mul- 
tiple optical filters for the purpose of color separation on 
55 the pupils of the image pickup optical system and on the 
image pickup element, the color purity can be en- 
hanced. This is because, by using the same kind of op- 
tical filters twice, the buildup of the transmission factor 
characteristics becomes steeper and the red color (R) 
40 and the blue color (B) do not overlap each other, it is to 
oe noted that the transmission factors of the optical fil- 
ters 52a, 52b, and 52c or of the optical filters 53a. 53b, 
and 53c are preferably set so as to provide appropriate 
signal levels in the respective image pickup regions in 
45 (he same accumulation time. 

[0023] In the image processing system 20, a color im- 
age is formed based on the selective photoelectric con- 
version output obtained from the plurality of images by 
the plurality of image pickup regions of the solid-state 
so image pickup element 1 20, respectively. Here, since the 
peak wavelength of the spectral luminous efficiency is 
555 nm, the signal processing is carried out using a G 
image signal including this wavelength, as the reference 
image signal. 

55 po24] When the pixel pitch of the solid-state image 
pickup element is f foed, compared with a system adopt- 
ed generally by a digital color camera in which an RGB 
color filter is formed on the solid-state image pickup el- 



's 

FA01 42/127 * RCVD AT 2/28/2007 4:00:28 PIW pastern Standard rimej * SVR:USPT0-IFXRF-1/1 9 * DNIS:2738300 * CSID:16508575487 * DURATION (mm-ss):33-00 



FEB, 28. 2007 1:06PM HP LEGAL IP 



NO. 111 P. 43 



£P1 0S7780A2 



ement with, for example, 2x2 pixel block basis to pro- 
vide wavelength eelectability to each pixel, and thus, an 
object image is separated into RGB images, the size of 
the object image is 1/V3 times, and thus, the focal length 
of the objective lens is about l/%'3 times, which is quite 
advantageous in thinning the camera. 
[0025] It is to be noted that, with regard to the spectral 
transmission factor characteristics of the optical filter© 
52a, 52b, and 52c and of the optical filters 53a, 53b. and 
53c," as shown in Pig. 6, and G overlap each other and 
G and B overlap each other, though R and B are almost 
separated from each other. 

{0026] Therefore, even when the image circle 51 b of 
the red light overlaps the image pickup region 120c for 
photoelectrical^ converting the blue light, and con- 
versely, even when the image circle 51 c of the blue light 
overlaps the image pickup region 120b for photoelectri- 
cally converting the red light, these images do not be- 
come the output of the image pickup regions. However, 
at the portion where the image circle 51 b of the red light 
overlaps the image pickup region 1 20a for photoelectri- 
cal^ converung the green light and at the portion where 
the image circle 51a of the green light overlaps the Im- 
age pickup region 120b for photoelectrically converting 
the red light, a small amount of an image of a different 
wavelength which should be blocked is superimposed. 
More specifically, since the selectivity of the object im- 
age is given by the product of the spectra! transmission 
lactor characteristics of the optical filter 52a and the 
spectral transmission factor characteristics of thecptical 
filter 53b. andbythe product of the spectral transmission 
factor characteristics of the optical filter S2b and the 
spectral transmission factor characteristics of the optical 
fitter 53a, the cross talk of the R image signal and the 6 
image signal does not become zero although it is small. 
[0027] Therefore, the objective lens 1 QO is further pro- 
vided with characteristics to lower the transmission fac- 
tor of the wavelength range of the portion where R and 
G overlap each other. This can be carried out by using 
optical filtering technology implemented by a color purity 
correction filter. 

[0023] The color purity correction filter is an optical fil- 
ter formed of a base material made of a transparent syn- 
thetic resin or glass having a predetermined amount of 
rare-earth metal ions contained therein. 
[00291 As the rare-earth metal ions, one or more se- 
lected among neodymium ions, praseodymium ions, er- 
bium ions, holmium tons are used. However, it is pref- 
erable thai at least neodymium ions are used as indis- 
pensable tons. It is to be noted thai trivalence ions are 
generally used as these ions. The content of the metal 
ions is selected in a range oi normally 0.01 to 40 mass 
parts, preferably 0.04 to 30 mass parts relative to 100 
mass parts of the base material of the objective lens 
100: 

[0030] As shown in Fig. 7, the color purity correction 
filter has characteristics to selectively absorb light in a 
predetermined wavelength range between the peak 



wavelengths of the color components of R, G, and B to 
decrease the amount of transmission thereof. This ac^ 
tion almost eliminates cross talk due to the overlap of 
the image circle 51 b of the red light and the image pickup 
s region 1 20a for photoelectrically converting the green 
light and the overlap of the image circle 51 a of the green 
light and the image pickup region 120b for photoelectn- 
cally converting the red light. 
[0031] Further, the objective lens 1 00 is also provided 
to w ah photochromic characteristics which is a phenome- 
non to be darkened by light and to be reversibly achro- 
matized when the irradiation of light is stopped. This is 
for, since the accumu (alien time control range of the sol- 
id-stats image pickup element 120 is limited, suppress- 
es ing the amount of light reaching the solid-state image 
pickup element when the field is extremely bright, there- 
by enlarging the recordable intensity range- 
[0032] A 5 the photochromic glass, tor example, pho- 
tochromic glass of phosphate glass made by Chance- 
so Pilkington which has osen put to practical use for spec- 
tacles (Product name: fteactolite Rapids) maybe used. 
[0033] Fig. 8 is a graph shewing the spectral trans- 
mission factor characteristics of a photochromic glass 
used as the objective lens 100. In Fig. 8. a solid line 
55 shows the characteristics after exposure to sunlight for 
20 minutes while a broken line shows the characteristics 
with no exposure to sunlight When the camera is car- 
ried about with the user outdoors under a blue sky or 
the like, light beams which enter the objective Jens 100. 
$o trom the diaphragm 110 makes the objective lens 100 
itself darkened to suppress the amount ot light entering 
the solid-state image pickup element 120 to be about 
1/2. As a result the accumulation time can be made 
twice as long, which raises the contra) limitation on the 
as high intensity side. 

[0004] The screen size of each of the image pickup 
regions 120a, 120b, and 120c is 2.24 mm X 1.68 mm 
as described in the above, since the pixel pitch is 2.8 
urn and the number of the pixels are 800 X 600. The 
40 diagonal screen size of each of the image pickup re- 
gions is 2.60 mm. Generally, when the image pickup an- 
gle e of a small-sized camera is about 70° in the diago- 
nal direction, the camera is most convenient. When the 
image pickup angle is 70°, the focal length is 2.0 mm in 
4S this case, since it is determined by the diagonal size of 
the screen. 

[0035] When a person or the like is the subject of re- 
cording, considering that a person is about 170 cm tall 
and one person to three people are often recorded at a 
50 time, a virtual distance D to the subject [mj can be de- 
fined as in the following equation (1 ) as a function of the 
omage pickup angle ©l*J: 



D = 1.4/tan(972) 



0) 



fp036] Substituting 70* for 9 of equation (1 ), D = 2.0 
m is obtained. Here, if the image pickup system 10 is 
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formed so as to focus on the subject best when the dis- 
tance to the subject is 2 m. the letting out of (he Ions 
from the point at infinity is 0.002 mm. Taking into con- 
sideration the allowable circle of confusion to be de* 
scribed later, there causes practically no problem even 
i! the image pickup system is a fixed focus image pickup 
optical system without a mechanism for letting the lens 
out, 

[0037J Afocal length f of a planoconvex lens put in the 
air can be represented as follows: 



obtained. _ 
[0041] Accordingly, the radii r of the spherical surfac- 
es of the lens portions 100a, 100b, and 100c are opth 
mteed with regard to the respective representative 

£ wavelengths. More specifically, here, no achromatism 
for removing the chromatic aberration over the whole 
visible region is notcarriedouianddesignsforthewave- 
lengths are applied to the respective lenses. First the 
equation (2) is transformed to obtain the following equa- 

10 tion(3): 



f = {1/(1-n)}r 



(2) 



r-(l-n)f 



(3) 



wherein n is the index of refraction and r is the radius of 
the spherical surface. Therefore, if the inde* of refrac- 
tion n of the objective lens 100 is 1 .5, for example, r for 
obtaining the focal length of 2.0 mm is 1 .0 mm. 
[003S] It is convenient to make equal the sizes of the 
red, green, and blue object images, since there Is no 
need to make correction of the image magnification, and 
thus, the processing time is not elongated. Therefore, 
the lens portions 100a, 100b. and 100c are optimized 
for the peak wavelengths of 530 nm. 620 nm, and 450 
nm of the lights which go through the PG B optical filters, 
respectively to make equal the magnifications of the re- 
spective images. This can be paraxially materialized by 
making equal the distance from the positions of the prin- 
cipal points of the respective lens portions to the solid- 
state image pickup element. 

[0039] In case of glass with the index of refraction of 
the d line (587.6 nm) n^ = 1 .5 and the Abbe number v d 
s= 60, the indexes of refraction at the wavelengths of 530 
nm, 620 nm, and 450 nm are about 1.503, 1.499, and 
1 .509> respectively. If all the radii r of the spherical sur- 
faces of the lens portions 100a, 100b. and 100c equal 
-1 .0 mm, thefocal lengths at the respective wavelengths 
are, by the equation (2), as follows: 

the lens portion 100a having the representative 
wavelength of 530 nm : 1 .986 mm. 
• the lens portion 100b having the representative 
wavelength of 620 nm : 2.004 mm, and 
the lens portion 100c having the representative 
wavelength of 450 nm : 1 .965 mm. 

[0040] suppose from the pixel pitch that the allowable 
circle of confusion ts 3.0 um and further suppose that 
the f-number of the objective lens is F5 6, the depth of 
focus represented as the product of the two is 1 6.8 um. 
It can be seen that the difference 0.039 mm between 
the focal length in case of 620 nm and the focal length 
in case of 450 nm already exceeds this. More specifi- 
cally, though the paraxial Image magnifications are the 
same, depending on the color of the subject, the subject 
may be out of focus. Since the spectral transmission fac- 
tor of an object normally ranges over a wide wavelength 
range, rt is quite rare that a sharp image in focus can be 



is [0042] inserting f = 2.0 and inserting in sequence n = 
1 .503, n = 1 ,499, and n = 1 .509 in the equation (3), the 
following respective radii are calculated: 

the lens portion 100a having the representative 
wavelength of 530 nm : r = -1 .006 mm. 
the lens portion 100b having the representative 
wavelength of 620 nm;r = -0,998 mm. and 
the lens portion 100c having the representative 
wavelength of 450 nm : r = -t .01 8 mm. 



20 



25 

[00431 !n oro * er to make welf-balanced the difference 
in the image magnifications at a high position of an im- 
age, the heights of the vertices of the lens portions 1 00a, 
100b, and 100c are slightly adjusted, andthen. both the 

90 sharpness and the image magnification are ideal. Fur- 
ther, non-spherical surfaces are used for the respective 
lens portions to satisfactorily correct the curvature of the 
image plane. With regard to the distortion of the image, 
it can be corrected in the signal processing to be carried 

35 out later. 

[0044] In this way, when reference G image signals 
by the green object light including the wavelength of 555 
nm which has the highest luminosity factor and image 
signals by the red and blue object lights, respectively. 

40 are obtained, and different focal lengths are set with re- 
gard to one wavelength and a substantially equal focal 
length Is set with regard to the representative wave- 
lengths in the respective spectral distribution in the Im- 
aging system, then by compositing these image signals. 

45 a color image with satisfactory correction of the chro- 
matic aberration can be obtained. Since each of the im- 
aging systems is formed of one lens, there can be also 
attained technological advantage of thinning the imag- 
ing system. Further, though achromatism normally re- 

so quires a combination of two lenses having different dis- 
persions, the achromatism is carried out here by only 
one lens, and thus, there can be also attained techno- 
logical advantage of lowering the cost. 
[0045] The objective lens 100 Is required to have high 

ss contrast image dissection up to the spatial frequency 
range as high as the pixel pitch. .The image pickup sys- 
tem 10 takes in three object images with regard to the 
three wavelength ranges, and thus, compared with an 
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image pickup system provided with a mosaic optical fil- 
ter such as of the Baiyer arrangement having the same 
number of pixels, as described in the above, the focal 
length is about 1/^3 times to attain the same image pick- 
up angle. Therefore, it is necessary to materialize high 
contrast image dissection of higher spatial frequency 
component. The optimization with regard to the respec- 
tive wavelengths of the lens portions described In the 
above is a technology for suppressing the chromatic ab- 
erration for the purpose of materializing this. 
[0046] Generally, there are two methods of improving 
the aberration characteristics of an image pickup optical 
system to make spurious resolution less liable to occur, 
thereby alleviating problems: one is to increase the de- 
gree of freedom in designing by, lor example, increasing 
the number of lenses forming the system, by making the 
lenses nonepherical. using anomalous dispersion glass, 
or by complexly using diffraction optical elements; and 
the other is to make narrower the imaging light beam, 

[0047] forTncr m** 0 * 3 - ^ l8 ' increase rf the de ' 
gree of freedom in designing is. though the focal length 
is \N3 times, toward complexity of the structure of the 
objective optical system, which goes against thin ning of 
the image pickup apparatus, and thus, is inappropriate. 
On the other hand, the latter method, that is. use of a 
narrower light beam conforms to a thin image pickup ap- 
paratus. 

[0048] when an imaging light beam is made narrower, 
as shown by a solid line b in Fig- 10. the response func- 
tion referred to as OTF presents gradual monotone de- 
crease in the low frequency component, and after that, 
becomes slightly negative, and then, becomes slightly 
positive. On the other hand, in case a broad light beam 
without narrowing is used, as shown by a broken line a 
in Fig. 10, the response function presents steep de- 
crease in the low frequency component, and after that, 
becomes temporarily negative, and then, becomes pos- 
itive again. 

[0049] The state where the OTF is negative indicates 
occurrence of spurious resolution. This corresponds to 
an actual state where reversal of negatrve/lpositive oc- 
curs, that is, a portion which should be white is Wack 
while a ponton which should be black is white. It makes 
it clear that a natural image can be obtained by making 
narrower the Imaging light beam. 
[0050] However, when the imaging light beam is ex- 
tremely narrowed, the contrast in a high frequency 
range is decreased due to diffraction of light. In this 
state, an image is formed of a bright spot at the center 
and diffraction stripes surrounding the bright spot. 
These are caused by, as known well, relative increase 
in the intensity of the diffraction stripes due to peripheral 
waves generated on the periphery of the opening of the 
diaphragm. 

[0051] The diffraction stripes can be decreased by 
adding to the objective lens a filter which is transparent 
at the center and becomes darker toward the periphery. 
This method is referred to as apodizatlon. which is de- 



scribed in detail on pages172to i74of "Kogaku Gijutsu 
Handbook Zohoban (Handbook of Optical Technology, 
Enlarged Edition) 0 (1975, Asakura Shoten). 
[0052] Fig. 9 is a graph showing the transmission fac- 
5 tor distribution of transmission factor distribution type fil- 
ters provided on the light incidence plane I00e of the 
objective lens 100 so as to face the diaphragm openings 
110a. 110b, and 110c. The transmission factor distnbu- 
tion'type filters are denoted as 54a, 54b, and 54c in Fig. 
10 1 The positions where the transmission factor is the 
highest correspond to the centers of the diaphragm 
openings 110a, 110b, and 110c while the positions 
where the transmission factor is zero correspond to the 
periphery of the openings 110a. HOb.andHOcrespec-. 
is t'rvely. of the diaphragm. In other words, thetransmission 
factor is distributed so as to be the highest at the cents rs 
of the diaphragm openings and so as to monotonically 
decrease toward the periphery. 
[0053] Such a transmission factor distribution type ffl- 
20 ter is formed by forming a thin film of Inconel. Chromel, 
• chromium or the like by vapor deposition or sputtering 
on the light incidence side of the objective lens 100. The 
characteristics shown in Fig. 9 can be obtained by mak- 
ingthe thinfilmthe thinnest at thecenterandthethickest 

25 on the periphery. It is to be noted that, in forming such 
a thin film, the position of a mask used in the vapor dep- 
osition or sputtering is continuously controlled. 
[0054] Though the transmission factor distribution 
type filters 54a, 54b, andS4c are formed on the objective 

30 lens here, the structure maybe that they are formed on 
a glass plate and are arranged on the light incidence 
side Drthe light projection side of the objective lens 100, 
[005S] Fig. 11 is a graph showing the intensity distri- 
bution in an image. In the figure, a broken line a shows 

s$ a case where the transmission factor is constant over 
the whole diaphragm opening, while a solid line b shows 
a case where the transmission factor is dec reased from 
the center of the diaphragm opening toward the periph- 
ery. Compared with the case of the characteristics 

40 shown by a, there is no bound on the periphery of the 
image in the characteristics shown by b, which clearly 
shows that the image formed is satisfactory. Here, This 
referects technological advantage of decreasing the dif- 
fraction stripes by decreasing peripheral light beams by 

45 means of apocfization. 

[OOSCf] Next, the relationship between the objective 
lens and the image pickup regions is described, since 
the image pickup system has three lens portions, the 
positions of the three object images relatively change 

so according to the distance to the subject As described 
in the above, each of the image pickup regions is sized 
to be 2,24 mm X 1 ,68 mm, and the image pickup regions 
are arranged adjacent to each other with their long sides 
being in contact with each other. Therefore, the center 

« to center distance of adjoining image pickup regions is 
1.68 mm. In tho YC processing circuit 230 to be de- 
scribed later, signal processing is carried out on the as- 
sumption that the center of an object image is the center 
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of the image pickup region. When an object image wilh 
the virtual object distance of 2 m is to be formed on the 
image pickup portion at the same intervals as that dis- 
tance, as ehown In Fig. 1 2, the interval between the lens 
portions lOOa and 100b and between the lens portions 
100b and 100c is set to be 1.6763 mm. In the figure, 
arrows 55a, 56b, and 55c denote imaging systems hav- 
ing positive power by thethree lens portions 1 00a, 1 00b p 
and lOQcof the objective lens 100. respectively, rectan- 
gles 55a, 56b. and 56c denote the ranges of the image 
pickup regions 120a, 120b. and 120c. respectively, and 
Lt , L2, and L3 are optical axes of the imaging systems 
SSa. 55b, and 55c, respectively. Since the light inci- 
dence surface of the objective lans 100 is a plane and 
the lens portions 100a. 100b, and 100c to be the light 
projection surface are spherical surfaces, perpendicu- 
lars from the respective centers of the spheres to the 
light incidence plane 100© are the optical axes. 
[0057] Here, as shown in Fig. 1 3. images of an object 
at Infinity are formed at the same intervals as that of the 
lens portions lOOa. 100b, and 100c. and thus, the inter- 
val between the G object image and the R object image 
and the interval between the R object image and the B 
object image are 1.6783 mm, which is a little smaller 
than the center-to-center distance of the image pickup 
regions ol 1.66 mm. The difference AY is 0.Q017 mm, i. 
e. , 1 .7 urn. With the G object image which has the high- 
est luminosity factor being as the reference object im- 
age, when the B object image moves, the difference AY 
is doubled and is 3.4 urn. Since it is often the case that 
a short-range object such as a person is positioned in 
the middle of a picture to be picked up and that a long- 
range object is positioned on the periphery of the pic- 
ture, and. since the aberration of the objective lens in- 
creases on the periphery of the picture to lower the qual- 
ity of an image, it can be understood that there is prac- 
tically no problem if the maximum image interval change 
is smaller than the pixel pitch multiplied by two. As de- 
scribed in the above, since the pixel pitch P of the solid- 
state image pickup element 120 is £B|Am, it follows that 
aY<2xP, and thus, the color misalignment in an image 
at infinity to this extent 4s allowable. 
[0050] Further, the interval between the images varies 
also according to temperature change of the image pick- 
up system 10. Since the imaging magnification of the 
image pickup system 10 is extremely small, the image 
interval variation AZ can be expressed as the difference 
between the expansion of the objective lens and the ex- 
pansion of the solid-state image pickup element in the 
following equation (4): 



[0059} Here, when oS = 0.26 x 10* AT=20[*C]. and 
the objective lens 1 00 is formed of low-melting glass and 
oLs 1.2 X 10*. AZ is calculated at 0.00032 [mm]. This 
k the variation in the interval between the G object im- 
5 age and the R object image and the variation in the in- 
terval between the R object image and the B object im- 
age. 

[0050] When the B object image is regarded as a var- 
iation with respect to the G object image which is the 

io reference image signals, since the interval between the 
Images is 1.6S X 2. the image interval variation is AZ X 
2 = 0.00063 [mm]. When the temperature range where 
the camera is used is 0 to 40*C, the deviation AT from 
the reference temperature of 20*C is 20"C. Here, if AZ 

15 x 2 is smaller than 1/2 of the pixel pitch, there is prac- 
tical no problem. Generally, the coefficient of linear ex- 
pansion oS of the solid-state image pickup element 120 
is as small asabout 0.26 x 10*. it is necessary to select 
the coefficient of linear expansion oL of the objective 

20 lens 1 00 so as to satisfy the following expression (5): 



2 = 1.68 x(aL-aS)X AT 



(4) 



2 X A X (aL-0.26 X 10" 5 ) X 20< 1/2 P 



(S) 



wherein aS is the coefficient of linear expansion of the 
solid-state image pickup element 120, aL is the coeffi- 
cient of linear expansion of the objective lens 100, and 
AT is the temperature change. 



25 wherein A is either the interval between the G image 
and the R Image or the interval between the R image 
and the B image and P is the pixel pitch. 
jp081] Since the coefficient cd- (= 1.2 * I0*)of linear 
expansion of the objective lens 100 used in the above 

& satisfies the relationship expressed by the expression 
(5), it can be understood that the matsrial of the lens 
100 is suitable for the camera. 
[0062] Further, apartf rom the fluctuation of the Image 
intervaJ due to the distance to the objectand duetotem- 

55 perature change, a method referred to as pixel shift is 
used where, by shifting relatively the Image pickup re- 
gions 120a, 120b, and 120c of the solid-state image 
pickup element by 1/2 pixel, the resolution is made high- 
er with a small number of pixels. The amount of the shift 

40 of -J >2 pixel Is set with regard tothe virtual object distance 
of 2 m. 

[0063] As shown in Pig. 15. the image pickup region 
120b for outputting the R image signals and the image 
pickup region 120c for outputting the B image signals 
45 are arranged so as to be shifted by 1/2 pixel both in the 
horizontal direction and in the vertical direction with re- 
spect to the image pickup region 1 20a for outputting the 
G image signals. 

p)064] This pixel shift may be materialized by making 
50 the lens portions 100b and 100c of the objective lens 
1 00 slightly offset wfth respect to the lens portion 1 00a, 
or may be materialized by making the image pickup re- 
gions 1 20b and 1 20c of the solid-state image pickup el- 
ement 1 20 slightly offset with respect to the image pick- 
55 up region 1 20a. 

[00S5] in an optical filter arrangement such astheBaJ- 
yer arrangement, since, for example, a pixel provided 
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with a red optical filler or 3 pixel provided with a blue 
optical filter is arranged between pixels provided with a 
green optical filter, an optica! low-pass filter for sup- 
pressing aliasing is necessary. However, in case of that 
images having different spectral distributions are taken 
in with regard to different image pickup regions, pixels 
provided with the respective optical filters can be dense- 
ly arranged, and, as a result, the influence of the aliasing 
is small, and thus, a high definition image can be ob- 
tained without the need for the optical low-pass filter. 
This makes it possible to miniaturize the image pickup 
system and to substantially lower the cost, 
[0066] Next the signal processing is described. 
[0067] As described in the above, an image pickup 
device having 1,800 pixels in Its lengthwise direction 
and 600 pixels in its breadthwise direction, Le. f having 
1 ,440,000 pixels in total is effectively applied to the sol- 
id-state image pickup element t20. Optical filters of the 
three primary colors, that is, red (R), green (G), and blue 
<B). are arranged on its front surface in predetermined 
regions respectively. 

[0068] As shown in Fig. 14, image signals read from 
the solid-state image pickup element 120 are supplied 
to the A/D converter 500 of the image processing sys- 
tem 20. The A/D converter 500 is. for example, a signal 
converting circuit for converting the signals into digital 
signals of. for example, ten bits according to the ampli- 
tude of the signal of each pixel and for outputting the 
converted signals. Then, the image signal processing is 
carried out in digital processing. 
[00691 Tne ima 9s processing system 20 has a signal 
processing circuit for obtaining image signals of a de- 
sired format from R, G. and B digital signals, and con- 
verts for converting R, G, and B color signals into YC 
signals expressed by a luminance signal Y and chromi- 
nance signals (Ft-Y) and (B-Y) or the like. 
[0070] The RGB image processing circuit 21 0 is a sig- 
nal processing circuit for processing the pixel signals of 
the 1800 x 800 pixels received from the solid-state im- 
age pickup element 120 through the A/D converter 500. 
and has a white balance circuit, a gamma control circuit, 
and an interpolation circuit for making the resolution 
higher by interpolation. 

[0071] The YC processing circuit 290 is a signal 
processing circuit for generating a luminance signal Y 
and chrominance signals R-Y and B-Y The YC process- 
ing circuit 230 is formed of a high luminance signal gen- 
erating circuit for generating high luminance signal YH, 
a low luminance 6ignal generating circuit for generating 
a low luminance signal YL and a chrominance signal 
generating circuit forgenerating chrominance signals R- 
Y and B-Y. A luminance signal Y is formed by compos- 
iting a high luminance signal YH and a low luminance 
signal YL. 

[0072] The RGB image processing circuit 210 is now 
described in detail. 

[0073] RGB signals outputted through the A/D con- 
verter 500 with regard to the R, G, and B regions, re- 



spectively, are first subject to predetermined white bal- 
ance adjustment in the white balance circuit in the RGB 
image processing circuit 2l0. and then are subject to 
predetermined gamma control in the gamma control cir- 
5 cuit. 

[0074] The interpolation circuit in the RGB image 
processing circuit 210 generates by interpolation, image 
signals having the resolution which is four times as 
much as that of the 600 X 800 pixels, converts the image 
10 signals from the solid-state image pickup element 120 
into signals having high definition image quality, and 
supplies them to the high luminance signal generating 
circuit, the low luminance signal generating circuit and 
the chrominance signal generating circuit at the subse- 
ts quent stage. 

[0075] Since the sizes of the R, G, and B object im- 
ages are already the same based on the setting of the 
objective lens 100. first, by a publicly known method, 
arithmetic processing for correcting optical aberration of 
so the objective optical system is carried out with regard to 
the respective image signals. Afterthat, the interpolation 
processing, the luminance signal processing, and the 
chrominance signal processing which are the same as 
those of an ordinary digital color camera are performed, 
25 The interpolation processing is as follows. 

[0076] First, a G image signal which is a reference im- 
age signal from the image pickup region 120a is subject 
to interpolation according to the following equations (6) 
to (9): 

90 



G2i2j = Gij 



(6) 



40 



G2i(2j +1) = GO-1/2 + M 

G(2i+1)2j = Gij-1/2 * G(i+1)j-1/2 (8) 

G(2i+1)(2j+1) = Gij-1/4 + GiG+1>1/4+ 

G(i+1 )j-1/4 + G(i+1 )G+1 MM ($) 



4& This is, 16 G elements are generated from each four G 
pixels, and thus the G image signals of 600x900 pixels 
from the image pickup region 120a are converted Into 
1200 X 1600 pixels. 

[0077] Then, R image signals from the image pickup 
so region 120b corresponding to the respective positions 
of the G image signals calculated using the above equa- 
tions (6) to (9) are subject to interpolation according to 
the following equations (10) to (19): 



R2i2j = R(i-1)fl-1)-V4 -t- R(M)j-1/4+ 

RfQ-1)/|/4 + Rij.1/4 (10) 
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R2i(2j*1 ) = R(M + R j i'^2 (1 1 ) 



R(2i+1 )2j = Rifr 1 )-1/2 + ffij-1/2 0 2) 



R(2M)(2M) = RS ( 13 > 

[0078] Since, as described in the above, the image 
pickup region ot the R object image and the image pick- 
up region of the B object image are arranged so as to 
be shifted by 1/2 pixel from the image pickup region of 
the Q object image, the original output ol the ij address 
is applied to the (2i+l )(2j+l ) address as indicated by the 
equation (13). 

[0079] Similarly to the R image signals, B image sig- 
nals from the image pickup region 120c corresponding 
to the respective positions of the G image signals cal- 
culated using the above equations (6) to (9) are subject 
tointerpolationaccordingto the following equations(l4) 
to (17): 

B2i2j = B(i-1)fj-1)-1/4 +■ B(i-1)j.1/4+ 

Bi(h1>1/4 + Bij-1/4 (14) 



B2i(2j+1) = B(j-1)-jl/2 + B1H/2 (15) 



B(2i+1)2j = Bi(j-1)-l/2 + Bij'1/2 (16) 



B(2i+1)(2j+1)=*Bij 07) 



[OOfiO] By the above processing, the R, G. and B sig- 
nals of 600 x 800 pbceis from the image pickup regions 
120a. 120b, and 120c are converted into R, G, and B 
signals of 1200 X 1600 pixels having high definition im- 
age quality, respectively. 

[0081] The high luminance signal generating circuit in 
the YC processing circuit 230 is a publicly known signal 
forming circuit for forming a high luminance signal YH 
from a color signal having the highest spatial frequency 
component among color component signals. The lowli> 
minance signal generating circuit is a publicly known 
signal forming circurt tor forming luminance signal YL of 
low frequency from a signal containing all the color com- 
ponents of R, G, and B. The chrominance signal gener- 
ating circuit is a publicly known arithmetic circuit for cal- 
culating chrominance signals R-Y and B-Y from highly 
definition RGB signals. 

[0082] The recording and reproduction system 30 is 
a processing system for outputting image signals to the 
memory and outputting image signals to the liquid crys- 
tal monitor 4, and includes a recording processing circuit 



900 for writing and reading image signals in and from 
the memory and a reproduction processing circuit 310 
tor reproducing image signals read from the memory as 
output to the monitor More specifically, the recording 
5 processing circuit 300 includes a compressing and ex- 
panding circurt for compressing YC signals representing 
a still image or a dynamic image according to a prede- 
termined compression format and for expanding the 
compressed data when it Is read from the memory. The 
10 compressing and expanding circuit includes a frame 
memory for signal processing and the like. YC signals 
from the image processing system 20 are stored on a 
frame basis, the signals are read on a plurality of block 
basis, and the signals are compression encoded. The 
is compression encoding is carried out by, for example, 
two-dimensional orthogonal transformation, normaliza- 
tion, and encoding according to Huffman method on the 
block basis. u 
[0083] The reproduction processing circuit 310 is a 
so circuit for carrying out matrix conversion of the lumi- 
nance signal Y and the chrominance signab R-Y and 
B^Y into, for example. RGB signals. Signals converted 
by the reproduction processing circuit 3i0areouiputted 
to the liquid crystal monitor 4. Thus, a visible image is 
25 displayed and reproduced. 

[□084] On the other hand, the control system 40 in- 
cludes control circuits for controlling, in response to ex- 
ternal operation, the image pickup system 1 0, the image 
processing system 20. and the recording and reproduc- 
50 tton system 30. respectively. It detects depression of the 
RELEASE button 8 to control driving erf the solid-slate 
image pickup element 120, operation of the RGB image 
processing circuit 210, compression processing of the 
recording processing circuit 300, and the like. Morespe- 
35 ciflcally. the control system 40 includes an operation de- 
tection circuit 41 0 tor detecting the operation of the RE- 
LEASE button 8, a system control unit 400 forcontrolting 
the respective portions in response to the detection sig- 
nal and generating and outputting timing signals when 
40 an image is picked up and the like, and a drive circuit 
420 for the solid-slate image pickup element 1 20, which, 
under control of the system control unit 400. generates 
drive signals for driving the solid-state image pickup el- 
ement 120. 

45 [0085] Next, operation of the image pickup apparatus 
according to the present embodiment is described with 
reference to Figs. 14 and 17A to 17C. First, when the 
main switch 5 is turned on, power source voltage Is sup- 
plied to the respective portions and then they become 

so operable. Then, it is determined whether an image sig- 
nal can be recorded or not in the memory. Here, the 
number of recordable pictures is displayed on the dis- 
play area 1 3 for the remaining number of pictures in a 
liquid crystal monitor 4 according to the remaining ca- 

99 pacity. An operator sees the display and. rf a picture is 
recordable, directs the camera to the field and presses 
down the RELEASE button 6. 
[00861 When the RELEASE button 6 is halfway 
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pressed down, the exposure time is calculated. When 
all the preparatory processing for taking a picture com- 
pletes, the camera is in a recordable state, and the op- 
erator is iniormed of this through the display. When the 
RELEASE button 6 is fulty pressed down, the operation 
detection circuit 41 0 transmits the detection signal to the 
system control unit 400. Here, the exposure time calcu- 
lated in advance is counted. When the predetermined 
exposure time elapses, a timing signal is supplied to the 
drive circuit 420. Then, the drive circuit 420 generates 
horizontal and vertical drive signals to sequentially read 
each of the exposed 1600 X 800 pixels in the horizontal 
direction and in the vertical direction. 
[0087] Tne read signals of respective pixels are con- 
verted by the A/D converter 500 into digital signals of a 
predetermined number of bits to be sequentially sup- 
plied to the RGB image processing circuit 210 of the im- 
age processing system 20. The RGB image processing 
circuit 21 0 carries out frrterpolation to quadruple the pix- 
el resolution after white balance adjustment and gamma 
control, and supplies the signals to the YC processing 
Circuit 290. 

[OOSS] In the YC processing circuit 230, the high lu- 
minance signaJ generating circuit generates high lumi- 
nance signal YH with regard to the respective RGB pix- 
els, and similarly, the low luminance signal generating 
circuit generates low luminance signal YL. The calculat- 
ed high luminance signal YH is outputted to an adder 
through a low-pass filter. In the same way, the low lumi- 
nance signal YL is, after subtraction of the high lumi- 
nance signal YH, outputted to the adder through the low 
pass filter. By this, the difference YL-YH between a high 
luminance signaJ and a tow luminance signal is added 
to obtain an luminance signal Y. Similarly, the chromi- 
nance signal generating circuit generates and outputs 
chrominance signals R-Y and B-Y. Components of the 
outputted chrominance signals R-Y and B-Y. which 
come through the low-pass filter, are supplied to the re- 
cording processing circuit 300. 
[0089] Next, the recording processing circuit 300 re- 
ceives the YC signals, compress the respective lumi- 
nance signal Y and chrominance signals R-Y and B-Y 
with a predetermined still image compression method, 
and records them sequentially in the memory. 
[0090] When a still image or a dynamic image is re- 
produced from image signals stored in the memory, the 
PLAY button 9 is pressed down, Then, the operation de- 
tection circuit 410 detects this operation to supply a de- 
tection signal to the system control unit 400, which 
makes the recording processing circuit 300 driven. The 
driven recording processing circuit 300 reads the re- 
corded content from the memory to display images on 
the liquid crystal monitor 4. The operator selects the de- 
sired image by pressing down a SELECT button or the 
like. 

[0091] Fig. 1 8 illustrates a second embodiment of the 
Image pickup system. Similarly to the case of the first 
system 790 has the three circular openings 11 Qa, 11 Ob, 



and 1 1 0c as shown in Fig. 3, Object light that enters the 
light incidence plane 1 00e of the objective lens 1 00 from 
the openings is projected from the three lens portions 
100a, 100b, and 100c of the objective lens 100 to form 

5 three object images on the image pickup plane of the 
solid-state image pickup element 120. 
[0092] The three lens portions 100a, 100b. and 100c 
have circular spherical surface portions as shown in Rg. 
5 showing the objective lens 100 viewed from the side 

10 where light is projected. An infrared radiation cutting fil- 
ter having a low transmission factor with respect to the 
wavelength range of 670 nm and more is formed on the 
spherical surface portions while a light shielding film is 
formed an the plane portion l00d shown with hatching. 

is More specifically, the objective optical system is formed 
of the objective lens 100 and the diaphragm nO, while 
the three lens portions 100a, 100b. and 100c are the 
imaging system. 

[0093] The solid-state image pickup element 120 is 
so identical to the one in the first embodiment shown "m Fig. 
2. The image circles 51a and 51b overlap each other 
and the image circles 51 b and 51 c overlap each other. 
[0034] In Rg. 18, thin plates 700©, 700b, and 700c 
arranged on the light incidence side of the diaphragm 

2* 1 1 0 are polarizing plates. As shown by arrows A, B, and 
C, the polarizing plates 700a and 700c are polarizing 
plates for transmitting light having en oscillation phase 
in the vertical direction of Figure 18. while the polarizing 
plate 700b is a polarizing plate for transmitting light hav- 

so ing the oscillation phase in an orthogonal direction (in 
the direction piercing the figure at right angles). 
[0095J Differently from the case of the first embodi- 
ment, since the optical filters for transmitting green, red, 
or blue light are not formed on the objective lens, an 

as object image formed in an image circle 701 a shown in 
Fig. 20 is a color image of linearly polarized light having 
an oscillation phase in the vertical direction in Fig. 18. 
an object image? ormed in an image circle 701 b is a color 
image of linearly polarized light having an oscillation 

40 phase in the vertical direction with respect to the plane 
of Fig. 1 8, and an object image formed in an image circle 
701 c is a color image of linearly polarized light having 
an oscillation phase in the vertical Erection in Fig. 18. 
in other words, these formed images are linearly polar- 

4$ feed light images with their oscillation phases being or- 
thogonal. 

[00SS] On the other hand, similarly to the case of the 
first embodiment, the optical filters 53a. 53b, and 53c 
are formed on the three image pickup regions 120a, 

so 120b, and 120c, respectively, of the solid-state image 
pickup element 120. Their spectral transmission factor 
characteristics are equivalent to the ones shown in Rg. 
6. Therefore, the image pickup regions 120a, 120b, and 
120c are sensitive to green light (G), red light (R), and 

ss blue light (B), respectively. 

[00971 Polarizing plates 702a, 702b, and 702c are ar- 
ranged In front of the image pickup regions of the solid- 
state image pickup element 120. As shown by arrows 
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D, E, and R the polarizing plates 702a, 702b. and 702c 
have transmission axes aligned with those of me polar- 
izing plates 700a, 70Qb ( and 700c. respectively. 
[0098] Since the amount of light received at the re- 
spective image picKup regions are given as the product 
of the spectral transmission factors of the pupils and the 
spectral transmi&ston factors of the image pickup re- 
gions, respectively, the combination of the pupil and the 
image pickup region is selected according to the trans- 
mission axes of the polarizing plates. More specifically, 
object light which goes through the diaphragm opening 
1 iOa is mainly photoelectrical^ converted in the image 
pickup region 1 20a, object light which goes through the 
diaphragm opening 110b Is mainly photoelectrically 
converted in the Image pickup region 120b, and object 
light which goes through the diaphragm opening mOc 
is mainly photoelectricany converted in the image pickup 
region 120c In other words, by the optical filters provid- 
ed on the solid-state image pickup element 120, the im- 
age pickup regions 120a 120b, and 120c output a G 
image, an R image, and a B Image, respectively. In this 
way, v\ the image processing system 20, a color image 
is formed based on the photoelectric conversion output 
of one of the plurality of images obtained in the plurality 
of image pickup regions of the solid-state image pickup 
element 120, respectively. In this case, since the peak 
wavelength of the spectral luminous efficiency is 555 
nm, the signal processing is carried out using a G image 
signal including this wavelength, as an reference image 
signal. 

[0099] When the pixel pitch of the solid-state image 
pickup element Is fixed, compared with a system adopt- 
ed in a conventional digital color camera in which an 
RGB color filter is formed on the solid-«tate image pick- 
up element with, for example, on 2 x 2 pixel basis to 
provide wavelength selectability to each of the pixels, 
and thereby an object image is separated into RGB im- 
ages, the size of the object image is i/>/3 times, and 
thus, the focal length of the objective lens is about 1/^3 
times. This is quite advantageous in thinning the cam- 
era 

[0100] Further, though complementary optical filters 
of cyan, magenta, and yellow having wide overlapping 
wavelength ranges can not be used in the first embod- 
iment Where an image is photoelectrically converted se- 
lectively based on the spectrum of the object image, the 
present embodiment makes it possible to use such com- 
plementary optical filters, since an image is photoelec- 
trically converted selectively based on the direction of 
oscillation of the light as described above and thus the 
overlapping of the wavelength ranges becomes irrele- 
vant. By using complementary optical filters, the light 
amount reaching the solid-state image pickup element 
can be increased compared with that when primary 
color filters are used. 

[0101J Inaddrtion. incaseof that an image is selected 
based on the direction of oscillation of the light, there is 
a degree of freedom in arranging the optical filters for 



the color separation. Fig, 10 illustrates another embod- 
iment where the position of the optical filters are 
changed Irom those in the embodiment shown m Fig. 
18. In an image pickup system 791 shown in Fig. 19, 
s optical filters for the color separation are provided on 
the light incidence plane 1 0Oe. not on the solid-state im- 
age pickup element 720. 

[0102] Fig, 21 is a sectional view showing a third em- 
bodiment of 1he image pickup system. The diaphragm 
to 11 0 and the objective lens 1 00 of an image pickup sys- 
tem 890 are identical tothe ones in the first embodiment 
F0103] Fig. 22 is a front view of a solioVstate image 
pickup element 820. Similarly to the case of the first em- 
bodiment shown in Fig, 2, the image circles 51a, S1b, 
75 and 51 c are formed on the solid-state image pickup el- 
ement 820. The image circles 51 a and 51 b overlap each 
other and the image circles 51b and 51c overlap each 
other. 

[010S] Differently from the case of the first embodi- 
20 merit, a microlens 821 is formed on image pickup re- 
gions 620a, 820b. and B20c with regard to light receiving 
portions (for example, 822a and 822b) of the respective 
pixels. Instead, optical filters for transmitting green lighi, 
red light, and blue light are not formed on the solid-state 
23 image pickup element 820. It is to be noted that, for the 
sake of clarity in explaining the microlens, the pixel shift 
among the image pickup regions is omitted in the illus- 
tration. 

[01 OS) The microlens B21 is offset with respect to the 
30 light receiving portions of the solid-state image pickup 
element 820. Tne amount of offset is set so as to be zero 
at the centers of the respective image pickup regions 
820a, 820b» and 820c and sd as to become larger to- 
ward the periphery. The direction of the offset »$.lhe di- 
ss rection of line segments connecting a center point Pa, 
Pb, or Pc of the image pickup regions S20a, 820b, or 
B20c and the light receiving portions, respectively. 
[01 OS] Fig. 23 is an explanatory view of the action of 
the microlens. and is a sectional view showing enlarged 
40 light receiving portions B22a and 822b at positions 
where the image pickup regions 820a and 820b are in 
contact with each other. A microlens 821a Is offset up- 
ward In the figure with respect to the light receiving por- 
tion 822a while a microlens 621 b is offset downward "m 
45 the figure with respect to the light receiving portion 822b. 
As a result light flux entering the light receiving portion 
822a is limited to a hatched region 823a while light flux 
entering the light receiving portion 822b is limited to a 
hatched region 823b. 
so [01071- The direction of the inclination of the light flux 
region 923a and the direction of the inclination of the 
light flux region 923b are opposite to each other, and 
are toward the lens portions 100a and 1 00b. respective- 
ly. Accordingly, by selecting appropriately the amount of 
55 the offset of the microlens, light flux projected only from 
particular pupils enters the image pickup regions. More 
specifically, the amount of offset can be set such that 
object light which goes through the diaphragm opening 
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110a is mainly photometrically converted in the Image 
pickup region 820a. object light which goes through the 
diaphragm opening 110b is mainly photoelectrical 
converted in the image pickup region 820b, and object 
light which goes through the diaphragm opening 110c 
is mainly photoelectricaliy converted in the image pickup 
region 820c. Since the optical filters 52a, 52b. and 52c 
are provided on the light incidence plane 100e of the 
objective lens 100, the image pickup regions 820a, 
820b. and 620c output a G image, an R image, and a B 
image, respectively. 

[01081 When the pixel pitch of the solid-state image 
pickup element is fixed, compared with a system adopt- 
ed by a conventional digital color camera in which an 
RGB color filter is formed on the solid-state image pick- 
up element with, for example, on a X 2 pixel basis to 
provide wavelength selectabflity to each of the pixels, 
and thereby an object image is separated into RGB im- 
ages, the size of the object image is times, and 
thus, the focal length of the objective lens is about 1N3 
times. This is quite advantageous in thinning the cam- 
era. 

[01 0?] Further, though complementary optical filters 
of cyan, magenta, and yellow having wide overlapping 
wavelength ranges can not be used in the first embod- 
iment where an image is photoelectricaliy converted se- 
lectively based on the spectrum of the object image, the 
present invention makes it possible to use such comple- 
mentary optical filters, since an image is photoelectri- 
caliy converted selectively by the offset of the microlens 
as described above and thus the overlapping of the 
wavelength ranges becomes irrelevant By using com- 
plementary optical filters, the light amount reaching the 
solid-state image pickup element can be increased 
compared with that when primary color filters are used. 
[01 1 0] in addition, in case ot that an image is selected 
by the offset of the microtens, the optical filters may be 
provided on the solid-state image pickup element 820 
instead of providing them on the light incidence plane 
1 00© of the objective lens 1 00. Regardless of the posi- 
tion of the oplicalfilters. the present embodiment is quite 
advantageous from the viewpoint of the Pght amount 
compared with the optical path in the first embodiment 
which goes through two optical filters and the optical 
path in the second embodiment using polarizing plates. 
In addition, it is also possible to provide the optical filters 
both on the light incidence plane 100e of the objective 
lens 100 and on the solid-state image pickup element 
820 to further decrease the cross talk of images. 
[0111] As described in the above, in the embodiment© 
described in the above, by constructing an image pickup 
apparatus so as to have a plurality of image pickup re- 
gions, an "imaging means for projecting an image of an 
object so that the image extends over one of the image 
pickup regions and another adjacent image pickup re- 
gion, and a suppressing means for suppressing photo- 
electric conversion in the another image pickup region 
of an Image signal from the subject inputted from the 



Imaging means, the following technological advantages 
can be attained. 

[011 2] (1 ) A thin digital color camera can be provided 
using a small-sized image pickup element which does 

s not requ ire an object image separating wall. 

[0113] (2) By forming object images of each of the 
wavelength ranges, pixels provided with the same kind 
of optical filters can be densely arranged, and. an image 
pickup system can be materialized which does not re^ 

to quire an optical tow-pass filterfor removing return alias- 
ing. 

[0114] Further, by using the suppressing means 
which is formed with a first plurality of color filters of dif- 
ferent wavelength ranges, provided on the plurality of 
1$ imaging means respectively, and a second plurality of 
color filters of the same wavelength ranges as those of 
the first plurality of color fitters, provided in the image 
pickup regions respectively, the following technological 
advantages can be obtained 
so [011 5J (3) A thin digital color camera can be provided 
using a small-sized image pecfajp element which is con- 
structed to be appropriate for obtaining a high color pu- 
rity image and which does not require art object image 
separating wall. 
& [oil fi] Still further, by using the suppressing means 
which is formed with a first plurality of polarizing means 
which have different polari2ing directions with regard to 
adjacent imaging means and which are provided corre- 
spondingly to the pluralityol imagingmeans, respectrve- 
so ly, and a second plurality of polarizing means of the 
same polarizing directions as those of the first plurality 
of polarizing means, whteh are provided corresponding- 
ly to the Image pickup regions, respectively, the follow- 
ing technological advantages can be obtained. 
35 [0117] (4) Athin digital color camera can be provided 
using a small-sized image pickup element which is eon- 
stracted without putting limitations on the optical filters 
for the color separation and which does not require an 
object image separating wall. 
40 [011 8] (5) Using complementary optical fillers can be 
made possible to materialize an image pfckup system 
which is advantageous from the viewpoint of the light 
amount. 

[0119J The individual components shown in schemat- 
45 icor block form in the drawings are all well-known in the 
camera arts and their specific construction and opera- 
tion are nc^crrUcaJtotheoperationorbest mode for car- 
rying out the Invention. 

[0120] While the present invention has been de- 
50 scribed with respect to what is presently considered to 
be the preferred embodiments it is to be understood 
that the Invention is not limited to the disclosed embod- 
iments. To the contrary, the invention is intended to cov- 
er various modifications and equivalent arrangements 
55 included within the spirit and scope of the appended 
claims. The scope of the following claims is to be ac- 
corded the broadest interpretation so as to encompass 
all such modifications and equivalent structures and 
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1 unctions. 

[0121] For example, in the described embodiments, 
optical filters used for the color separation are primary 
color filters of red, green, and blue. However, the 
present invention is also applicable to a case where 
these filters are replaced by complementary color filters 
of cyan, magenta, and yellow. 
[0122] Further, in the above embodiments, an object 
image having the highest luminosity factor (green) is 
used as a reference to describe change in the intervals 
between the object image having the highest luminosity 
factor and object images having other luminosity factors 
(other colors), which is caused by change in the distance 
to the object. However, the present invention is also ap- 
plicable to a case where an object image having the 
highest luminosity factor (green) is not used as the ref- 
erence. 

[0123] it is to be noted that in the present invention, 
the respective embodiments in the above or technical 
elements thereof may be freely combined depending on 
the situation. 

[0124] Also, in the present invention, the whole or part 
of the appended claims or of the structure of an embod- 
iment may term one apparatus, may be combined with 
another apparatus, or may be an element of an appara- 
tus. 



Claims 



1- An image pickup apparatus, characterized by com- 
prising: 

first and second image pickup portions (120a - 
120c, 820a - 820d) for receiving at least a first 
wavelength component of an object light and a 
second wavelength component of the object 
light different from said first wavelength compo- 
nent, respectively; 

first and second optical systems (100a - 100c, 
600a - 800d) for projecting the object light onto 
said first and second Image pickup portions, re- 
spectively, via different optical paths, said sec- 
ond optical system projecting the object light al- 
so onto said first image pickup portions; and 
a guide path forming portion (52a - 52c. 53a - 
53c, 700a - 700c, 702a - 702c, 821) for forming 
a guide path for receiving the object light pro- 
jected by said first optical system and guiding 
the received object light to said first image pick- 
up portion, said guide path forming portion re- 
ceiving the object light projected by said second 
optical system onto said first image pickup por- 
tion and not guiding the received object light to 
said first image pickup portion. 

2. An image pickup apparatus according to claim 1, 
characterized in that said first wavelength compo- 



nent is a representative wavelength of light of afirst 
spectral distribution and said second wavelength 
component is a representative wavelength of light 
of a second spectral distribution Which is different 
s from said first spectral distribution. 

3. An image pickup apparatus according to claim Z 
characterized in that 6aid first spectral distribution 
is a spectral distribution including peak wavelength 

io of a luminosity factor. 

4. An image pickup apparatus according to claim 1 , 
characterized in that said first wavelength compo- 
nent is included in a spectral distribution including 

75 peak wavelength o1 a luminosity factor. 

5. An image pickup apparatus according to claim 1, 
characterized in that said first and second wave- 
length components are two different color compo- 
se nents among red, green, and blue. 

6. An Image pickup apparatus according to claim 1, 
characterized In that each of said first and second 
optica] systems comprises filter means (52a - 52c. 

25 53a - 53c) for extracting said first and second wave- 
length components. 

7. An image pickup apparatus according to claim 1, 
characterized in that each of said first and second 

so optical systems comprises a single lens (100a - 
100c. BOOa-BOOd). 



8. An image pickup apparatus according to claim 7, 
characterized in that said single fenses of said first 

35 and second optical systems are integrally formed of 
a glass material or a resin material. 

9. An image pickup apparatus according to claim 8, 
characterized by further comprising: 

40 a light shielding layer (100dt SOOf) provided 

between said Integrally formed single lenses. 

10. An image pickup apparatus according to claim 1, 
characterized in that each of said first end second 

45 optical systems comprises a single lens (100a - 
100C, 8 00a • sood) provided with an infrared radia- 
tion cutting filter. 

11. An- image pickup apparatus according to claim 1, 
so characterized in that each of said first and second 

optical systems comprises photochromic glass, 

12. An image pickup apparatus according to claim 1, 
characterized in that each of said first and second 

55 optical systems comprises a color pu rity correction 
filter (100a - 100c, 800a - 800d). 

13. An image pickup apparatus according to claim i. 
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characterized in that each of said first and second 
optical systems comprises filter mean© (54a - 54c) 
whose transmission factor becomes smaller as the 
distance from an optical axis thereof becomes long- 
er. 

14. An image pickup apparatus according to claim 1. 
characterized in that, when a virtual object distance 
D [m] is defined as a function of an image pickup 
angle 81°] of said first or second optical systems to 
be D = 1 .4 / tan (#2), an interval between optical 
axes of said first and second optica! systems is set 
such that change in an interval between an object 
image of said first wavelength component received 
by said first image pickup portion and an object im- 
age of said second wavelength component re- 
ceived by said second image pickup portion be- 
tween when an object is at said virtual distance and 
when the object is at infinity is smaller than a pixel 
pitch of said image pickup portions multiplied by 
two. 
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15- An image pickup apparatus according to claim 1, 
characterized in that said first and second image 
pickup portions are integrally formed. s * 

16. An image pickup apparatus according to claim 1. 
characterized in that said first and second image 
pickup portions are formed in a plane shape. ^ 

17. An image pickup apparatus according to claim 1, 
characterized by further comprising; 

a plurality of openings (110a - 110c, 810a - 
61 Oc) for taking in external light through said first 
and second optical systems. 



18. An image pbkup apparatus according to claim 1, 
characterized in that said guide path fomning portion 
comprises first filter m eane (52a - 52c) for extracting 
said first wavelength component and second filter 
means (53a - 53c) for extracting said first wave- 
length component which comes through said first 
filter means. 



1a An image pickup apparatus according to claim 1, 
characterized in that said guide path forming portion 
comprises first polarizing filter means (700a - 700e) 
for transmitting the object light received by said first 
image pickup portion and second polarizing filter 
means (702a - 702c) of a same polarizing direction 
as that of said first polarizing fitter means for trans- 
mitting the object light which comes through said 
first polarizing filter means. 

20. An image pickup apparatus according to claim 1, 
characterized in that said guide path forming portion 
includes a microlens (821) for receiving the object 
light projected by said first optical system and guid- 
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ing the object light to said first image pickup portion, 
sakJ microlens receiving the object light projected 
by said second optical system onto said first image 
pickup portion and not guiding the object light to 
said first image pickup portion. 

An image pickup apparatus according to claim V 
characterized in that said guide path forming portion 
includes a microlens (921) for receiving the object 
light projected by said first optical system and guid- 
ing the object light to said first image pickup portion, 
said microlens being offset so as to receive the ob- 
ject light projected by said second optical system 
onto said first image pickup portion and not to guide 
the object light to said first image pickup portion. 
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